But business at Millers Bakery with locations in Tenafly, Cliffside Park and soon Secaucus is only picking up.
"I've really never worked harder," said Miller, 55.
Millers Bakery opened in 1947 by Otto Miller, David's grandfather.
Donald Miller, David's dad, took over and then passed things on to David and his brother, Dwight.
The kitchen was manned by men up until five years ago, when customers began asking for specialty cakes. Now, David's wife, Donna Miller, and four other women are the ones doing the decorating.
"It's a completely different element," said Miller, a father of two. "Most places want three weeks or a month's notice, but we're doing some cakes on a two-day turnaround."
When Miller heard that the dress shop in the storefront next to his Anderson Avenue store was going out of business, he decided to turn it into a showroom just for his cakes.
The original bakery is on the corner, where it's always been.
The showroom is filled with styrofoam replicas of actual cakes that Millers has produced. Millers can make any type of cake -- from sports themes to fashion lines.
Most of the bakery's orders are for weddings, sweet sixteens or bar/bat mitzvahs, Miller said.
Despite the changing industry, Miller is pleased with the direction of his business.
"Some days it feels like work," he said. "But most, days I love it."
Click here to follow Daily Voice Hackensack and receive free news updates.